System for virtual display and method of use

ABSTRACT

A preferred system and method for projecting a business information model at a construction site includes a network, a system administrator connected to the network, a database connected to the system administrator, a set of registration markers positioned in the construction site, and a set of user devices connected to the network. The system includes a hard hat, a set of headsets mounted to the hard hat, a set of display units movably connected to the set of headsets, a set of cameras connected to the set of headsets, and a wearable computer connected to the set of headsets and to the network. The cameras capture an image of the set of registration markers. A position of the user device is determined from the image and an orientation is determined from motion sensors. A BIM is downloaded and projected to a removable visor based on the position and orientation.

FIELD OF THE INVENTION

The present invention relates to systems and methods managingdistribution and use of information at a construction site. Inparticular, the present invention relates to systems and methods fordisplaying and using a business information model and other constructioninformation at a construction site. The present invention also relatesto virtual display systems, such as heads up displays.

BACKGROUND OF THE INVENTION

A major goal of any contractor in the building industry is timely jobcompletion. Hence, efficiency is a paramount concern.

Scheduling of construction projects often requires numerous subtasks.The subtasks are often interdependent. These subtasks must necessarilybe completed in order to maximize efficiency. For example, electricalconduit and foundation pads must be in place before installation ofelectrical equipment can begin. If an error is made in anyinterdependent subtask, it must be corrected before other tasks canproceed. Hence, correcting errors made in interdependent subtasks isexpensive and time consuming because it often delays project completion.

Furthermore, heavy equipment such as cranes and elevators are scheduledto be on site at specific times when they are needed. If errors insubtasks are made, then the equipment must be either stored orrescheduled quickly, leading to increased construction costs and delayin project completion.

In a similar way, delivery of certain engineering, mechanical andscheduling information is critical to timely project completion. Forexample, engineering change orders, site drawings, schematics,photographs, tool type and location, physical equipment specificationsand diagrams and repair manuals and parts lists for heavy equipment allare required to be easily available at a construction site for maximumefficiency. Other critical construction information includes queuingtimes and scheduling times for skilled personnel, tools and equipment.Any delay in receiving such critical information can effect timelyproject completion.

In order to be useful, construction information is generally accessed inthe field at a construction site by paper drawings or in some cases, ona laptop computer. However, neither paper drawings nor laptop computersdisplay the information to scale. Viewing information in this manner isoften difficult to do and can lead to dangerous and costly mistakes.

Modern construction projects have attempted to remedy many of theinefficiencies caused by lack of timely information delivery and errorsin interdependent subtasks by employing a consolidated buildinginformation model (BIM). The BIM is a set of computer graphics filesthat, when viewed on a CAD system, provide the current displays of wireframe models of structures in the completed construction project. TheCAD display is layered in a manner that allows all separate views andaccurate representations of all structures, physical equipment, wiringand plumbing. While the BIM has helped coordination of tasks andschedules, it is still not completely satisfactory because it is noteasily accessible in the field. Further, the BIM does not addressschedules or query times.

The prior art has attempted solutions to solve some of these problemswith limited success. For example, U.S. Publication No. 2014/0184643 toFriend discloses a system and method of dynamically coordinatingmachines and personnel about a physical worksite using augmented contenton an operator display device. To receive the augmented content, whichis generated by an off-board management system, the operator displaydevice is associated with a transmitter/receiver attached to a machine,such as an excavator or bulldozer. A position of the machine orpersonnel is determined by a GPS system or a laser scanning system. Theoperator display device includes a visor or goggles with transparentlenses, a scaled-down controller that includes a processor or otherelectronics to communicate with a personnel transmitter/receiver carriedby a person and a controller that processes information signals receivedfrom the off-board management system and project them on the lenses ofthe operator display device. The augmented content is projected in theperson's field of view as an overlay superimposed on the surroundingenvironment to show restricted area for personnel, routes of travel formachinery, and areas designated for excavation. However, the operatordisplay device of Friend cannot determine its position without aconstruction site. Further, it does not display or interact with a BIMmodel.

U.S. Publication No. 2014/0210856 to Finn et al. discloses a system andmethod that integrates augmented reality technology with land surveying.A 3D digital model of internal elements of a building is generated usinga 3D laser scanner upon installation of the internal elements, such aselectrical and plumbing before wall panels are installed. The 3D digitalmodel is associated with a set of markers that are placed on a finishedwall in the building. The markers are used to project the generated 3Dmodel on a mobile device, such as a smartphone, in view of a user.However, the system in Finn requires the 3D model to be generated oncethe internal systems are already installed, sometimes incorrectly, justprior to installing wall paneling. Therefore, the system in Finn cannotbe used to prevent incorrect installation of building elements leadingto costly construction overruns.

U.S. Publication No. 2014/0268064 to Kahle et al. discloses a system andmethod for projecting an image on a surface in a building underconstruction. The system includes a projector mounted on a moveablesupport for supporting a worker at a work position in the building. Theprojector projects the image on a surface above the moveable support inresponse to an image signal defining the image to be projected. Theprojected image indicates the location of connectors, anchors, and holesto be affixed to, or cut through, the surface and features behind thesurface. A positioning system for determining the two dimensionalposition of the projector includes a laser measuring system thatprojects a rotating beam of laser light that sweeps across the moveablesupport to determine the distance and heading of the moveable support.However, the system in Kahle is prone to error because the lasermeasuring system is easily misaligned in the construction environment,thereby providing an incorrect position to the projector. Further, thesystem must be attached to the moveable support and cannot betransported easily between construction sites.

Therefore, there is a need in the art for a portable augmented realitysystem that provides access to virtual information accurately, in realtime, at a construction site to prevent mistakes, thereby increasing theusability of the information and improving safety, time use and costefficiency.

SUMMARY

A system and method for projecting information including, as an example,segments of a business information model at a construction site includesa network, a system administrator connected to the network, a databaseconnected to the system administrator, a set of registration markerspositioned in the construction site, and a set of user devices connectedto the network. Each user device includes a hard hat, a set of headsetsmounted to the hard hat, a set of display units movably connected to theset of headsets, a set of registration cameras connected to the set ofheadsets and directed towards the set of registration markers, and awearable computer connected to the set of headsets and to the network.

The wearable computer is programmed with a set of instructions to carryout the method which includes the steps of receiving the businessinformation model, receiving a position image of the set of registrationmarkers, receiving a set of motion data, determining a position of theuser device and an orientation of the user device based on the positionimage and the set of motion data, rendering the business informationmodel based on the position, the orientation, and the position image asa rendered business information model, and displaying the renderedbusiness information model as a stereoscopic image to the user.

The described embodiments herein disclose significantly more than anabstract idea including technical advancements in the fields ofconstruction management and data processing, and a transformation ofdata which is directly related to real world objects and situations. Thedisclosed embodiments enable a computer and integrated optics anddedicated electrical components to operate more efficiently and improvethe optical display of the BIM and other information and constructionmanagement technology in general.

BRIEF DESCRIPTION OF THE DRAWINGS

In the detailed description presented below, reference is made to theaccompanying drawings.

FIG. 1 is a schematic of a BIM distribution system of a preferredembodiment.

FIG. 2 is a schematic diagram of a user device of a preferredembodiment.

FIG. 3A is a side view of a user device of a preferred embodiment.

FIG. 3B is a side view of a camera matrix of a preferred embodiment.

FIG. 4A is a front view of a user device of a preferred embodiment.

FIG. 4B is an isometric view of a user device of a preferred embodiment.

FIG. 4C is an isometric view of a display unit of a preferredembodiment.

FIG. 4D is an exploded isometric view of a connection for a display unitof a preferred embodiment.

FIG. 5 is a top view of a camera matrix of a preferred embodiment.

FIG. 6 is a top view schematic of a projector unit and ray diagram of apreferred embodiment.

FIG. 7A is a top view schematic of a projector unit and a virtual imageof a preferred embodiment.

FIG. 7B is a point of view of an augmented image of a preferredembodiment.

FIG. 8 is a plan view of a user device and a registration system of apreferred embodiment.

FIG. 9A is a schematic of a registration marker of a preferredembodiment.

FIG. 9B is a schematic of a registration marker of a preferredembodiment.

FIG. 10 is a schematic of a data flow for an augmented realityapplication of a preferred embodiment.

FIG. 11 is a command input menu for a user device of a preferredembodiment.

FIG. 12 is a flow chart of a state machine method of a preferredembodiment.

FIG. 13 is a flow chart of a method for registering a marker of apreferred embodiment.

FIG. 14A is a flow chart of a method for calibrating a position of auser device of a preferred embodiment.

FIG. 14B is a top view schematic of a camera position with respect to aregistration marker of a preferred embodiment.

FIG. 14C is a side view schematic of a camera position with respect to amarker of a preferred embodiment.

FIG. 14D is a captured skewed image of a registration marker of apreferred embodiment.

FIG. 14E is a flow chart of a method for deskewing an image of apreferred embodiment.

FIG. 14F is a deskewed image of a preferred embodiment.

FIG. 14G is a side view schematic of a camera and a registration markerof a preferred embodiment.

FIG. 15 is a flow chart of a runtime process of a preferred embodiment.

FIG. 16 is a flow chart for method of determining a position of a userdevice of a preferred embodiment.

FIG. 17 is a flow chart for a method of rendering a stereoscopic overlayfor a user device of a preferred embodiment.

FIG. 18 is a flow chart of a method for updating a business informationmodel of a preferred embodiment.

FIG. 19 is a flow chart of a method for updating a business informationmodel of a preferred embodiment.

DETAILED DESCRIPTION

It will be appreciated by those skilled in the art that aspects of thepresent disclosure may be illustrated and described in any of a numberof patentable classes or contexts including any new and useful processor machine or any new and useful improvement.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, C++, C#, .NET, Objective C, Ruby, Python SQL, or othermodem and commercially available programming languages.

Referring to FIG. 1, system 100 includes network 101, systemadministrator 102 connected to network 101, and a set of user devices104 each of which is connected to network 101. System administrator 102is further connected to BIM database 103 for storage of relevant data.For example, receiving data may include a business information model,engineering change orders, textual data, equipment manuals and operationinstructions, images, photos, text messages, videos, emails, graphics,documents, 2-dimensional and 3-dimensional drawings, and sketches.

In a preferred embodiment, each of user devices 104 communicates withsystem administrator 102 to access BIM database 103 to project a BIM aswill be further described below.

It will be appreciated by those skilled in the art that any type ofthree-dimensional rendering may be employed in the disclosed embodimentand that a BIM is just one example of such a three-dimensionalrendering.

Referring to FIG. 2, user device 200 includes wearable computer 201connected to headset 202. Wearable computer 201 is further connected toreplaceable battery 203, microphone 204, control input device 206, andspeaker 205.

Wearable computer 201 includes processor 207 and memory 209 connected toprocessor 207, and network interface 208 connected to processor 207.Augmented reality application 210, BIM 211, and a set of videos, images,and data 212 are stored in memory 209. In one embodiment, control inputdevice 206 is connected to wearable computer 201. In preferredembodiment control input device 206, is a remote control having anavigation pad and a selection button. Any type of control input deviceknown in the art may be employed.

Headset 202 is further connected to display unit 213 and a set ofcameras 214. Headset 202 includes processor 215, a set of sensors 216connected to processor 215, and memory 217 connected to processor 215.

Referring to FIG. 3A, a preferred implementation of user device 200 isdescribed. Hard hat 302 is worn by user 301. Hard hat 302 has pocket 305integrally formed in it. In a preferred embodiment, the hard hatincludes a “pocket and clip” arrangement used to secure the headset asshown and described in U.S. Pat. No. 8,191,292 to Cummings, et al.,which is incorporated herein by reference. Various types of head coversor helmets may be employed to support the headset. Headset 303detachably mounts to hard hat 302 by flexible mounts 304 attached tocase 350 and pocket 305. Headset 303 is further connected to wearablecomputer 313 via connection 314. Wearable computer 313 is preferably aportable computing device, such as a laptop or tablet computer, worn asa backpack by user 301. Connection 314 provides a data and powerconnection from wearable computer 313 to headset 303. Headset 303includes processor 310, memory 311 connected to processor 310, andsensors 312 connected to processor 310. Mounting arm 306 is slidablyinserted into headset 303 to allow forward and backward movement. In apreferred embodiment, the mounting arm is biased by a mechanical coilspring which enables it to retract into case 350. Display arm 307 ispivotably connected to mounting arm 306 for pivotal movement about axis324. Display unit 308 is attached to display arm 307. Display unit 308includes projector 325, camera 326, and display light guide 309. Camera326 has field of view 328. In a preferred embodiment, field of view 328is 90°. In other embodiments, other suitable field of view ranges may beemployed. Display arm 307 is further connected to headset 303 with dataand power connection 327.

User 301 wears communication device 315. Communication device 315includes earpiece speaker 316 and microphone 317. Communication device315 is preferably connected to wearable computer 313 via a wirelessconnection such as a Bluetooth connection. In other embodiments, otherwireless or wired connections are employed. Communication device 315enables voice activation and voice control of an augmented realityapplication stored in the wearable computer 313 by user 301.

In one embodiment, camera matrix 318 is detachably connected to headset303. Camera matrix 318 includes halo 319 and halo 321, each of which isdetachably connected to headset 303. A set of base cameras 320 isconnected to halo 319 and in communication with headset 303. A set ofangled cameras 322 is connected to halo 321 and in communication withheadset 303.

Referring to FIG. 3B in another embodiment, camera matrix 318 isattached inside surface 329 of hard hat 302. In this embodiment, halos319 and 321 are attached to inside surface 329 of hard hat 302 with asuitable adhesive or fastener. Hole 334 is integrally formed in hard hat302 adjacent to headset 303 for connection to camera matrix 318. In apreferred embodiment, connector 335 is a USB 3.0 connector, connected toa processor of headset 303 and positioned in hole 334 to connect tocamera matrix 318. Other suitable data connections may be employed. Setof base cameras 320 is connected to halo 319, each of which ispositioned in a hole of set of holes 330. Set of holes 330 is integrallyformed in hard hat 302. In one embodiment, side cameras 333 of set ofbase cameras 320 are attached to headset 303 outside of hard hat 302. Inanother embodiment, side cameras 333 are eliminated. Set of angledcameras 322 is connected to halo 321, each of which is positioned in ahole of set of holes 331. Set of holes 331 is integrally formed in hardhat 302.

In another preferred embodiment, the cameras are each mounted securelyto the inside surface of the hard hat and are positioned to view theoutside world through the holes.

In a preferred embodiment, a BIM is downloaded from a systemadministrator server into a memory resident in a wearable computer 313.The BIM is transmitted from wearable computer 313 through headset 303and projector 325 for viewing adjacent eye 323 of user 301 to augmentthe vision of user 301, as will be further described below. The user canselect different layers of the BIM to view via voice control. Forexample, the BIM includes an electrical layer, which shows the locationof electrical conduit, connection points, and equipment. As the usermoves, headset 303 and wearable computer 313 tracks the location of user301 and the position and orientation of the user's head using camera 326and/or camera matrix 318.

In one embodiment, a set of data is downloaded, selected, and displayedto user 301. In one embodiment, the position and orientation of theuser's head is not tracked in a display mode. Rather, the data isdisplayed without regard to the position of the user or hard hat. Anytype of data content may be selected, formatted, scaled and displayed,including images, photos, text messages, videos, emails, graphics,documents, drawings, and sketches.

In a preferred embodiment, processor 310 is a 2.8 GHz octa-coreSnapdragon 810 processor available from QUALCOMM® Technologies, Inc.Other suitable processors known in the art may be employed.

In a preferred embodiment, sensors 312 is a 9-axis motion trackingsystem-in-package sensor, model no. MP11-9150 available fromInverSense®, Inc. In this embodiment, the 9-axis sensor combines a3-axis gyroscope, a 3-axis accelerometer, an on-board digital motionprocessor, and a 3-axis digital compass. In other embodiments, othersuitable sensors and/or suitable combinations of sensors may beemployed.

In a preferred embodiment, memory 311 is a 2 GB LPDDR3 RAM. Othersuitable memory known in the art may be employed.

In a preferred embodiment, each of base cameras 320 and angled cameras322 is a 16 megapixel smartphone camera capable of recording video at 30fps that includes a CMOS image sensor, part no. 5K3M2 available fromSamsung Semiconductor. Other suitable cameras and/or image sensors knownin the art may be employed.

Referring to FIG. 4A, user device 400 includes display unit 402 whichincludes camera 404 on the temporal side of eye 406 of user 401 anddisplay light guide 405. Camera 404 has field of view 413. Display lightguide 405 is positioned in the field of view and adjacent to eye 406.Display unit 402 is movably connected to headset 403, which isdetachably mounted to hard hat 407. Display unit 409 is movablyconnected to headset 408, which is detachably mounted to hard hat 407.Display unit 409 includes camera 410 on the temporal side of eye 412 ofuser 401. Camera 410 has field of view 414. Display light guide 411 isin the field of view and adjacent to eye 412. Display units 402 and 409and headsets 403 and 408 are the same as previously described. Displayunits 402 and 409 provide a stereoscopic augmented view to user 401.

In a preferred embodiment, each of cameras 404 and 410 is a 16 megapixelsmartphone camera capable of recording video at 30 fps that includes aCMOS image sensor, part no. 5K3M2 available from Samsmung Semiconductor.Other suitable cameras and/or image sensors known in the art may beemployed.

Referring to FIGS. 4B, 4C, and 4D in one embodiment, hard hat 407inchludes pocket 450 integrally formed in hard hat 407 and adjacent topocket 449. Glasses 451 includes display arm 452 adjustably engaged withconnector 453 and display arm 469 adjustably engaged with connector 470.Mounting arm 454 is adjustably engaged with connector 453. Mounting arm471 is adjustably engaged with connector 470. Data connection 468connects display unit 409 to headset 408 detachably mounted to pocket449, as previously described. Display arm 452 includes a set of ridges462 integrally formed on it. Mounting arm 454 includes flexible mounts455 to detachably mount glasses 451 to hard hat 407. Mounting arm 454further includes a set of ridges 463 integrally formed on it. Connector453 has mount portion 456 and display portion 457. Mount portion 456includes channel 458 integrally formed in it. Channel 458 has ridge 459integrally formed on it. Mounting arm 454 slidingly engages with channel458. Set of ridges 463 engages with ridge 459 to enable adjustablepositional movement along directions 464 and 465. Display portion 457includes channel 460 integrally formed in it. Channel 460 includes ridge461 integrally formed on it. Display arm 452 slidingly engages withchannel 460. Set of ridges 462 engages with ridge 461 to enableadjustable positional movement along directions 466 and 467.

Likewise, display arm 469 includes a set of ridges 472 integrally formedon it. Mounting arm 471 includes flexible mounts 476 to detachably mountglasses 451 to a pocket in hard hat 407. Mounting arm 471 furtherincludes a set of ridges 477 integrally formed on it. Connector 470 hasmount portion 478 and display portion 479. Mount portion 478 includeschannel 475 integrally formed in it. Channel 475 has ridge 480integrally formed on it. Mounting arm 471 slidingly engages with channel475. Set of ridges 477 engages with ridge 480 to enable adjustablepositional movement along directions 464 and 465. Display portion 479includes channel 473 integrally formed in it. Channel 473 includes ridge474 integrally formed on it. Display arm 469 slidingly engages withchannel 473. Set of ridges 472 engages with ridge 474 to enableadjustable positional movement along directions 466 and 467. Glasses 451includes display light guides 405 and 411 and display units 402 and 409,as previously described. Display unit 402 is connected to headset 403with a data connection.

In a preferred embodiment, channel 458 is generally perpendicular tochannel 460 and vice versa. Other arrangements may be employed.

In a preferred embodiment, channel 475 is generally perpendicular tochannel 473 and vice versa. Other arrangements may be employed.

In a preferred embodiment, each of display anus 452 and 469, connectors453 and 470, and mounting arms 454 and 471 is made of an injectionmolded plastic. Other suitable materials known in the art may beemployed.

In one embodiment, mount portion 456 and display portion 457 areseparate pieces attached to each other with a suitable adhesive orepoxy. In another embodiment, mount portion 456 and display portion 457are integrally formed portions of a single piece adjacent to each other.Other attachment means known in the art may be employed.

In one embodiment, mount portion 478 and display portion 479 areseparate pieces attached to each other with a suitable adhesive orepoxy. In another embodiment, mount portion 478 and display portion 479are integrally formed portions of a single piece adjacent to each other.Other attachment means known in the art may be employed.

Referring to FIG. 5, camera matrix 318 will be further described. Cameramatrix 318 includes halo 501 and halo 502 connected to halo 501. Each ofcameras 503, 504, 505, and 506 is connected to halo 501. Camera 503 hasfield of view 507. Camera 504 has field of view 508. Camera 505 hasfield of view 509. Camera 506 has field of view 510. Each of cameras511, 512, 513, and 514 is connected to halo 502. Camera 511 has field ofview 515. Camera 512 has field of view 516. Camera 513 has field of view517. Camera 514 has field of view 518.

In a preferred embodiment, each of cameras 503, 504, 505, and 506 ispositioned approximately 90° with respect to each other around halo 501.Other angular intervals may be employed.

In a preferred embodiment, each of cameras 511, 512, 513, and 514 ispositioned approximately 90° with respect to each other around halo 502.Other angular intervals may be employed.

In a preferred embodiment, each of field of views 507, 508, 509, and 510is approximately 90°. Other field of view ranges may be employed.

In a preferred embodiment, each of field of views 515, 516, 517, and 518is approximately 90°. Other field of view ranges may be employed.

In a preferred embodiment, camera matrix 318 provides a 3600 view of thesurroundings of a user. In other embodiments, other numbers of cameras,angular positions, and field of view ranges may be employed to provide a360° view.

Referring to FIG. 6, each of display units 402 and 409 will be furtherdescribed as display unit 600. Display unit 600 will be furtherdescribed with respect to a right eye of a user. It will be appreciatedby those skilled in the art that the arrangement of display unit 600 issimply reversed for implementation on a left eye. Display unit 600includes light guide 601, projector 602 attached to light guide 601, andcamera 603 connected to and adjacent to light guide 601 and projector602. Camera 603 is connected to headset 615 and includes lens 604.Projector 602 includes light source 605. Light source 605 is connectedto headset 615. Collimating lens 606 is positioned adjacent to lightsource 605. Light guide 601 includes input surface 607 and outputsurface 608, each of which is attached to the interior of light guide601. Each of input surface 607 and output surface 608 is positioned atangles (a and 7, respectively from front surface 613 to provide totalinternal reflection (“TIR”) for light guide 601, thereby projecting animage in field of view 610 of user eye 609.

In a preferred embodiment, angles ω and γ, are 30° and 45°,respectively. Any angles may be employed to provide TIR for light guide601.

In use, light source 605 displays an image received from headset 615.The image is represented by rays 611 and 612. Rays 611 and 612 aretransmitted through collimating lens 606 and reflected off of inputsurface 607 for TIR. Rays 611 and 612 are further reflected off of frontsurface 613 and rear surface 614 and output surface 608 in field of view610 of user eye 609.

In a preferred embodiment, light source 605 is an organic light emittingdiode (“OLED”) display such as the WUXGA OLED-XL Microdisplay, part no.EMA-100801-01, available from eMagin Corporation. In another embodiment,light source 605 is a light emitting diode (“LED”) display. Othersuitable light sources and displays known in the art may be employed.

In a preferred embodiment, light guide 601 is made of acrylic. Inanother embodiment, light guide 601 is made of poly (methylmethacrylate) (“PMMA”). Other suitable materials known in the art may beemployed.

In a preferred embodiment, input surface 607 is a flat mirror and outputsurface 608 is a partially-reflective mirror, such as a half-silveredmirror. In other embodiments, other combinations for input surface 607and output surface 608 may employed and are summarized in Table 1 below.

TABLE 1 Combinations for Input and Output Surfaces Output SurfaceDiffraction Single Multiple grating Diffraction Reflective Reflective(varying Grating Holographic Input Surface Surface Surfaces index)(lines) Element Single Reflective x x x x x Surface Multiple Reflectivex x x x x Surfaces Combination x x x x x Refractive/Reflective ElementDiffraction Grating x x x x x (varying index) Diffraction Grating x x xx x (lines) Holographic x x x x x Element

Referring to FIG. 7A in use, lens 705 of camera 704 is automaticallyfocused on real object 706 at a distance d from camera 704 and sent toheadset 710 as image 707. Headset 710 and wearable computer 711determine distance d and the position of display unit 701 with respectto real object 706. Wearable computer 711 generates virtual image 708based on distance d. Projector 703 projects virtual image 708 into lightguide 701, as previously described. Virtual image 708 is displayed asvirtual object 709 to appear at distance d′ in view of user eye 702.Virtual object 709 is magnified to coincide with the size and positionof real object 706 to create a perceived depth of focus d. In oneembodiment, d′ is less than d. In another embodiment, d′ is equal to d.In one embodiment, d′ is a fixed distance from camera 704 for all realobjects.

Referring to FIG. 7B, point of view 712 is the view a user sees whilewearing a headset and display unit. Point of view 712 includes floor 713and adjoining wall 714. Registration marker 715 is attached to floor713. Registration marker 716 is attached to wall 714. Real object 718 isbeing lowered into position. According to the BIM, the correct locationfor real object 718 is outlined by virtual object 717. In this way, auser easily determines if real object 718 is properly positioned and canquickly make adjustments to ensure real object 718 is properlypositioned.

In one embodiment, a set of data 719 is displayed. The set of data 719includes image 720 and text 721. Any type of data including images,photos, text messages, videos, emails, graphics, documents, drawings,schematics, diagrams, and hand-drawn sketches may be employed. Forexample, image 720 is an installation diagram of real object 718 andtext 721 is a set of installation instructions for real object 718.

Each of the positions and sizes of image 720 and text 721 is optionallychanged by the user.

In one embodiment, set of data 719 is displayed simultaneously withvirtual object 717. In another embodiment, set of data 719 is displayedwithout virtual object 717 in a display mode, as will be furtherdescribed below.

Referring to FIG. 8, construction site 800 includes floor 801 andadjoining walls 802 and 803. Registration system 804 includesregistration markers 805, 806, and 807 positioned at precise locationson floor 801, wall 802 and wall 803, respectively and serve as a set ofreference points for user device 808 worn by user 809.

Each of the positions of registration markers 805, 806, and 807 isassociated with a position in a BIM. Survey location 810 is preciselypositioned at a known location at construction site 800 and saved in theBIM. Reference marker 811 is a master reference point based on thelocation of the survey location 810. Each of registration markers 805,806, and 807 is positioned from reference marker 811 to ensure properlocation of floor 801 and walls 802 and 803. At least one ofregistration markers 805, 806, 807, and 811 will be in view of a cameraof user device 808 worn by user 809 and at any given time. The cameracaptures an image of at least one of registration markers 805, 806, 807,and 811. A wearable computer of user device 808 decodes the capturedimage to determine a real location of at least one of registrationmarkers 805, 806, 807, and 811. The wearable computer determines acorresponding virtual location in the BIM.

For example, user 809 is standing in construction site 800 wearing userdevice 808 and looking down at location 812 where object 813 is to beinstalled. Registration marker 805 is in view of user device 808. Theprojected BIM shows the correct installation position 814 in view ofuser 809 as if the user were standing inside the BIM. As user 809 tiltshis or her head up to look at wall 802 the movement of the user's headis detected by user device 808 and registration marker 806 is in view ofuser device 808. Based on the position of registration marker 806, theBIM is moved and rotated in real time to align with the user's field ofvision and provide an in-person view of the BIM to user 809. Crane 815lowers object 813 towards location 812. Based on the projected BIM,object 813 should be installed at installation position 814. User 809uses the projected BIM to properly lower the object 813 and preciselyinstall object 813 at proper installation position 814, thereby savingtime and money in the form of overrun construction costs.

If a mistake is found, user 809 captures still images using the camerafor upload to the system administrator or records or streams video backto the system administrator. In this way, the party responsible for themistake can be easily and quickly identified.

Referring to FIGS. 9A and 9B, registration marker 901 includes shape 903and code 904. Registration marker 902 includes shape 905 and code 906.Any polygon may be employed for shapes 903 and 905.

In a preferred embodiment, each of codes 904 and 906 is atwo-dimensional bar code. In this embodiment, each of codes 904 and 906includes a set of marker information, including a set of dimensions ofshapes 903 and 905, and a set of x, y, z coordinates position at whichregistration markers 901 and 902 are placed, and a description of eachshape and location. Any type of code may be employed.

Shapes 903 and 905 enable detection of codes 904 and 906, respectively,at an offset angle. For example, shape 903 is an equilateral triangleand shape 905 is a rectangle. If a camera capturing an image of shapes903 and 905 is positioned at an offset angle, shapes 903 and 905 willappear as a scalene triangle and a parallelogram, respectively, in askewed image.

Referring to FIG. 10, data flow 1000 for augmented reality application1001 for a user device will be described. BIM 1002 is input intoaugmented reality application 1001. Application commands 1003 provideinput control for the processes of augmented reality application 1001.Images 1004 are received and sent by augmented reality application 1001.For example, a set of cameras captures a set of registration images. Theset of marker images is used to determine the position of the user. Inanother example, images 1004 are still or video images captured by a setof cameras adjacent to the eyes of the user and saved to memory forlater upload or streamed to a server. Point of view image 1005 iscaptured by the set of headset cameras adjacent to the eyes of a user.Set of data 1007 is input into augmented reality application 1001.

In a preferred embodiment, the position of the user is determined fromthe set of code images 1004 by augmented reality application 1001.Augmented reality application 1001 orients BIM 1002 according to thedetermined position of the user. Commands 1003 determine which layers ofBIM 1002 are displayed. Augmented reality application 1001 overlays theselected layers of BIM 1002 at the determined position to generatestereoscopic image overlay 1006 for display.

In one embodiment, commands 1003 determine a subset of set of data 1007to display and the size and position of the subset of the set of data.Augmented reality application 1001 overlays the selected subset of data1007 according to the selected size and position of the set of data 1007for display.

Referring to FIG. 11, commands menu 1100 includes standby/run toggle1101, BIM layer selection 1102, reload BIM 1103, save overlaid image1104, and calibrate 1105. Standby/run toggle 1101 toggles the augmentedreality application to a standby mode or a run mode. BIM layer selection1102 enables the user to select any layer of the BIM to view. Forexample, the layers include, but are not limited to, structural,electrical, plumbing, data, and HVAC. Reload BIM button 1103 downloadsthe BIM into memory. Save overlaid image 1104 captures a “screencapture” of the point of view and the overlaid BIM from the perspectiveof the user. Calibrate 1105 executes a calibration process, as will befurther described below. Position and orientation toggle 1106 togglesthe position and orientation functions on and off to selectively run ina display mode. Select data 1107 enables the user to select which datato display and the size and the position of the selected data. Selectionof 1101, 1102, 1103, 1104, 1105, 1106, and 1107 is accomplished viavoice controls.

Referring to FIG. 12, state machine method 1200 for an augmented realityapplication will now be described. State machine method 1200 begins atstep 1201 in a power off mode. Once the system is enabled in step 1202by initiating power, state machine method 1200 proceeds to a standbymode at step 1203. Once a “run” command is received, state machinemethod 1200 proceeds to step 1204. At step 1204, a position and anorientation function of the augmented reality application is toggled onor off. If toggled off then the augmented reality application runs in adisplay mode at step 1205 and optionally displays a set of dataselectable by the user. The augmented reality application runs in thedisplay mode until the user toggles the position and the orientationfunction on at step 1204. If turned on, then state machine method 1200proceeds to step 1206.

At step 1206, state machine method 1200 turns on a set of cameras andbegins to search for a registration marker in a loss of “marker lock”mode. At step 1207, a position and orientation of a user device isdetermined from the registration marker, as will be further describedbelow. If the position and orientation of the user device cannot bedetermined, then state machine method 1200 returns to step 1206 tosearch for a registration marker. If the position and orientation of theuser device is determined, then state machine method 1200 proceeds tostep 1208. At step 1208, the augmented reality application runs in a“marker lock” mode, that is the position and orientation of the userdevice can repeatedly be determined within a predetermined time. In thisstep, a runtime loop for the augmented reality application is initiatedand a BIM is displayed, as will be further described below. In apreferred embodiment, the predetermined time is 30 seconds. Other timesmay be employed.

In one embodiment, the set of data is displayed when the augmentedreality application runs in the “marker lock” mode.

At step 1209, a consistency is determined. In this step, if the positionand orientation of the user device can be repeatedly determined withinthe predetermined time, then state machine method 1200 returns to step1208. In this step, if the BIM is properly displayed, i.e., is rotatedand aligned with the user point of view, then stated machine method 1200returns to step 1208. If the position and orientation of the user devicecannot be repeatedly determined within the predetermined time or the BIMis not properly displayed, i.e., is not rotated and aligned with theuser point of view, then state machine method 1200 proceeds to step1210. At step 1210, a message is displayed to the user indicating aposition and orientation consistency problem and state machine method1200 begins a calibration process at step 1211, as will be furtherdescribed below.

Referring to FIG. 13, method 1300 for registering a registration markerfor a BIM will be described. The registration marker includes a shapeand a code, as previously described. At step 1301, a position of theregistration marker is calibrated. In this step, a surveyor or a userpositions the registration marker in a desired location. For example,the registration marker is placed in the middle of a wall or a column ora stud. Any desired location may be employed. Measurements are taken toensure the registration marker is placed in the desired location. Atstep 1302, a set of location coordinates of the placed registrationmarker is stored in the code and in the BIM. At step 1303, a set ofdimensions for the shape of the registration marker is stored in thecode and in the BIM. At step 1304, a description of the registrationmarker is stored in the code and the BIM. Method 1300 is repeated foreach registration marker.

Referring to FIG. 14A, method 1400 for calibrating a position of a userdevice will be described. At step 1401, a camera of the user device ispointed at a registration marker so that the registration marker iswithin a field of view of the camera.

Referring to FIGS. 14B and 14C, an offset position of user device 1409with respect to registration marker 1411 shown in a top view and a sideview, respectively, will now be described. User device 1409 has camera1410. Camera 1410 has camera axis 1414. Registration marker 1411 is inview 1413 of camera 1410. Registration marker 1411 has marker axis 1412.Camera 1410 and user device 1409 is positioned offset with respect toregistration marker 1411. Position angle α is the angle between markeraxis 1412 and camera axis 1414 in the x-z plane of coordinates 1415.Position angle β is the angle between marker axis 1412 and camera axis1414 in the y-z plane of coordinates 1415. In one embodiment,registration marker 1411 is rotated about the z-axis of coordinates1415.

Because of the offset position of user device 1409 and camera 1410 asdefined by position angles α and β, the image of registration marker1411 is skewed.

Returning to FIG. 14A, at step 1402, an image of the registration markeris captured by the camera.

Referring to FIG. 14D, skewed image 1416 includes skewed registrationmarker 1442. Skewed registration marker 1442 includes skewed shape 1417and skewed code 1418. Skewed registration mark 1442 is in the x-y planedefined by x-axis 1419 and y-axis 1420. Z-axis 1421 traversesperpendicularly through skewed registration mark 1442. As can be seen inFIG. 14D, skewed registration mark 1442 appears as a parallelogram. Inthis example, skewed registration mark 1442 is rotated approximately 30°about each of x-axis 1419, y-axis 1420, and z-axis 1421.

Returning to FIG. 14A, at step 1403, a set of edges in the image of theregistration marker is located. In this step, Gaussian smoothing isfirst applied to the image to reduce noise in the image. In a preferredembodiment, Canny edge detection is then employed to locate the set ofedges. In other embodiments, other edge detection means may be employed.In one embodiment, edge thinning is applied to the set of edges toremove any unwanted points. In a preferred embodiment, the set of edgesis a boundary of the shape of the registration marker.

At step 1404, the image is deskewed in order to determine a set ofposition angles with respect to the registration marker, as will befurther described below.

At step 1405 the code is read to determine the set of dimensions of theshape of the registration marker, including an actual height and anactual width. At step 1406, a distance from the camera to theregistration marker is determined.

At step 1407, an absolute position of the user is calculated based onthe position angles and the distance from the registration marker.

Referring to FIG. 14E, step 1404 will be further described as method1422 for deskewing an image. Method 1422 begins at step 1423. At step1424, a set of reference lines for the set of edges of a registrationmarker is determined. In a preferred embodiment, the set of referenceslines is determined by the Hough transform. Other suitable methods knownin the art may be employed.

At step 1425, a pair angle is calculated between each pair ofintersecting reference lines to generate a set of pair angles. At step1426, a skew angle is calculated from set of pair angles by averagingthe set of pair angles. At step 1427, the image is rotated about an axisby the skew angle. The skew angle is the position angle with respect toeach axis, as previously described. At step 1428, whether or not theimage has been deskewed for all axes is determined. If not, method 1422advances to the next axis at step 1429 and returns to step 1424. If so,method 1422 ends at step 1430.

Referring to FIG. 14F, deskewed image 1443 includes deskewedregistration marker 1444 along x-axis 1419, y-axis 1420, and z-axis1421. Deskewed registration marker 1444 includes deskewed shape 1431 anddeskewed code 1432. Deskewed registration marker 1444 is approximatelyperpendicular to z-axis 1421. Deskewed code 1432 can now be read.Deskewed image 1443 has height 1433 and width 1434. Deskewedregistration marker 1444 has height 1435 and width 1436.

In a preferred embodiment, each of heights 1433 and 1435 and widths 1434and 1436 is measured by counting the number of pixels for deskewedregistration marker 1444 and deskewed image 1443.

Referring to FIG. 14G, step 1406 will now be further described. Camera1437 has field of view 1438 spanning an angle θ, which varies dependingon the type of camera employed. Registration marker 1439 is in plane1440. Plane 1440 is distance 1441 from camera 1437. Height 1442 ofregistration marker 1439 is retrieved from a code contained inregistration marker 1439. Distance 1441 is calculated by:

$\begin{matrix}{{d = \frac{h}{x\mspace{14mu} \tan \mspace{14mu} \theta}},} & {{Eq}.\mspace{14mu} 1}\end{matrix}$

where d is distance 1441, h is height 1442, θ is angle θ of field ofview 1438, and x is a height percentage of the height of the deskewedregistration marker in the deskewed image to the height of the deskewedimage. For example, if the height of the deskewed registration marker is60% of the height of the deskewed image, then x=0.6.

Referring to FIG. 15, runtime process 1500 for an augmented realityapplication will now be described. Runtime process 1500 starts at step1501. At step 1502, a BIM is retrieved. In this step, the BIM isdownloaded from a system administration server and saved into memory ofa user device. At step 1503, an image is captured from a set of cameras.At step 1504, a position and an orientation of the user device isdetermined, as will be further described below. At step 1505, astereoscopic overlay of the BIM is rendered according to the positionand the orientation of the user device, as will be further describedbelow. At step 1506, the rendered stereoscopic overlay is output to adisplay unit of the user device for display to the user. In a preferredembodiment, the rendered stereoscopic overlay is rendered at least 24fps.

In one embodiment, a set of data is retrieved at step 1507. In thisstep, the set of data is downloaded from the system administrator andsaved into the memory of the user device. In one embodiment, theposition and the orientation function is deactivated. In anotherembodiment, the position and the orientation function remain activated.At step 1508, a subset of the set of data is selected for displayincluding the size and the position of the selected set of data. At step1509, the selected subset of data is displayed on the display unit.

At step 1510, a determination is made as to whether an end command hasbeen received. If not, runtime process returns to step 1503. If so,runtime process 1500 ends at step 1511.

Referring to FIG. 16, step 1504 will be further described as method 1600for determining a position and an orientation of a user device. Method1600 begins at step 1601. At step 1602, a set of registration markers isidentified and decoded to determine the position of the user device. Ina preferred embodiment, method 1400 is employed. At step 1603, a set ofmotion detection data is received from a set of sensors in the userdevice to determine movement of the user device. At step 1604, the setof motion detection data and the position of the user device arecombined to determine an x, y, z position of the user device in realityand in the BIM and a roll, pitch, and yaw or detection of the userdevice in reality and the BIM. In this step, the user device determineswhich camera captured the image of the registration marker, i.e., atemporal camera or a camera of the camera matrix. If the camera of thecamera matrix captures the images, then a difference angle is calculatedbetween an axis of the camera of the camera matrix and an axis of thetemporal camera. The orientation is calculated from the set of positionangles and the difference angles. The set of motion detection datareceived is the roll, pitch, and yaw orientation movement of the head ofthe user. Method 1600 ends at step 1605.

Referring to FIG. 17, step 1505 will be further described as method 1700for rendering a stereoscopic overlay according to the position and theorientation of the user device for a user device. Method 1700 begins atstep 1701. At step 1702, a BIM is rotated and magnified based on theposition and the orientation of the user device. At step 1703, the BIMis “clipped” based on a set of barriers in the BIM, i.e., the nearestset of walls. For example, if the user is standing the middle of a room,the BIM is “clipped” to only show the room of the BIM in which the useris standing. Otherwise, the entire BIM of the entire building would beshown to the user. At step 1704, a layer selection of the BIM isdetermined from the command menu. At step 1705, the selected layers ofthe “clipped” BIM is rendered as a stereoscopic image, i.e., the BIMimage is rendered as a pair of BIM images, a left BIM image for a leftdisplay unit and a right BIM image for a right display unit of the userdevice. Method 1700 ends at step 1706.

In a preferred embodiment, the left BIM image and the right BIM imageare shifted with respect to each other, in a range of approximately 2.5to 3 inches to compensate for the average distance between the pupils ofhuman eyes.

Referring to FIG. 18, method 1800 for updating a BIM will now bedescribed. Method 1800 begins at step 1801. At step 1802, a virtuallocation of a virtual object in the BIM is determined by viewing thevirtual location on a display unit of a user device. At step 1803, anactual location of a real object associated with the virtual object isdetermined. At step 1804, a tolerance for the real object location isdetermined by any measuring means. In a preferred embodiment, thetolerance is determined by a set of building codes. At step 1805, theactual location is compared to the virtual location to determine whetherthe actual location is within the tolerance. If so, then method 1800ends at step 1809. If the actual location is not within the tolerance,then method 1800 proceeds to step 1806. At step 1806, an image iscaptured of the actual location and the virtual location as seen throughthe display by the user. At step 1807, the captured image is uploaded toa system administrator server. At step 1808, the captured image is savedin the BIM as a “mistakes” layer. The “mistakes” layer is then aselectable layer in the BIM once a user reloads the BIM to the userdevice from the system administrator server. Method 1800 ends at step1809.

Referring to FIG. 19 in another embodiment, method 1900 for updating aBIM will now be described. Method 1900 begins at step 1901. At step1902, a streaming session between a user device and a systemadministrator server is initiated and a video is captured and streamedin real time to the system administrator server. The video includes thepoint of view of the user captured by a camera with the overlaid BIM. Atstep 1903, a virtual location of a virtual object in the BIM isdetermined by viewing the virtual location on the display. At step 1904,an actual location of a real object associated with the virtual objectis determined. At step 1905, a tolerance for the real object location isdetermined by any measuring means. In a preferred embodiment, thetolerance is determined by a set of building codes. At step 1906, theactual location is compared to the virtual location to determine whetherthe actual location is within the tolerance. If so, then method 1900ends at step 1908. If the actual location is not within the tolerance,then method 1900 proceeds to step 1907. At step 1907, the video is savedin the BIM in a “mistakes” layer as a selectable element, such as anicon or link. The “mistakes” layer is then a selectable layer in the BIMonce a user reloads the BIM to a wearable computer from the systemadministrator server. The user selects the selectable element to streamand view the video. Method 1900 ends at step 1908.

It will be appreciated by those skilled in the art that the describedembodiments disclose significantly more than an abstract idea includingtechnical advancements in the field of data processing and atransformation of data which is directly related to real world objectsand situations in that the disclosed embodiments enable a computer tooperate more efficiently and make improvements to constructionmanagement technology. Specifically, the disclosed embodiments eliminatethe remanufacture of construction components and rescheduling ofequipment. Further, the disclosed embodiments eliminate the reliance anduse of external positioning systems, such as GPS or laser-based systems.

It will be appreciated by those skilled in the art that changes could bemade to the embodiments described above without departing from the broadinventive concept. It is understood, therefore, that this disclosure isnot limited to the particular embodiments herein, but it is intended tocover modifications within the spirit and scope of the presentdisclosure as defined by the appended claims.

1. A visor for a construction hard hat capable of renderingsemi-transparent information comprising: a pocket rigidly attached tothe hard hat; a headset removably attached to the pocket; and, a displayunit, operatively connected to the headset, for displaying thesemi-transparent information on an inside surface of the visor.
 2. Thevisor of claim 1, wherein the display unit further comprises: aprojector; a light guide attached to the projector; and, a view cameraoperatively positioned adjacent the projector and the light guide. 3.The visor of claim 1, wherein the display unit further comprises: a setof registration cameras positioned on the hard hat to view a 360° areabout a vertical axis of the hard hat; and, a computer operativelyconnected to the set of registration cameras and the display unit andprogrammed to: receive position information from the set of registrationcameras; calculate a BIM display view based in the position information;and, send the BIM display view to the display unit as thesemi-transparent information.
 4. The visor of claim 3, wherein thedisplay unit further comprises: a verbal command translator, operativelyconnected to the computer; and, wherein the computer is furtherprogrammed to: receive a verbal command from the verbal translator, and,change the BIM display view based on the verbal command.
 5. The visor ofclaim 2, wherein the projector further comprises: a light source; and, alens adjacent to the light source.
 6. The visor of claim 5, wherein thelight guide further comprises: a set of interior surfaces; an inputsurface attached to the set of interior surfaces and adjacent to theprojector; and, an output surface attached to the set of interiorsurfaces opposite the input surface.
 7. The visor of claim 6, whereinthe input surface is positioned at a first angle to provide totalinternal reflection in the light guide.
 8. The visor of claim 6, whereinthe output surface is positioned at a second angle to project arendering out of the light guide.
 9. The visor of claim 1, wherein thesemi-transparent information is one or more of the group of constructionplans, queuing information, tool locations, photographs, text, equipmentmanuals and parts lists.
 10. The visor of claim 1, wherein thesemi-transparent image is displayed by the display unit as astereoscopic image.
 11. A device for projecting a building informationmodel based on a remotely monitored set of registration markscomprising: a headset; a display unit, connected to the headset, forprojecting a translucent image onto a surface of the headset; a set ofregistration cameras connected to the headset; and, a computeroperatively connected to the headset and to the set of registrationcameras, programmed to: access a video image from the set ofregistration cameras of one or more registration marks of the set ofregistration marks; derive a viewer perspective from the video image;derive a building information model view from the viewer perspective;and, send a first signal to the display unit based on the buildinginformation model view to be displayed as the translucent image.
 12. Thedevice of claim 11, further comprising: a verbal communication deviceconnected to the computer; and, wherein the computer is furtherprogrammed to: receive a verbal command from the verbal communicationdevice; and, send a second signal to the display unit based on theverbal command.
 13. The device of claim 11, wherein the set ofregistration cameras are arranged to encompass a 360° field of view. 14.The device of claim 11, wherein each display unit of the set of displayunits further comprises: a projector; a light guide attached to theprojector; and, a view camera adjacent to the projector and the lightguide.
 15. The device of claim 14, wherein the projector furthercomprises: a light source; and, a lens adjacent to the light source. 16.The device of claim 15, wherein the light guide further comprises: a setof interior surfaces: an input surface attached to the set of interiorsurfaces and adjacent to the projector; and, an output surface attachedto the set of interior surfaces opposite the input surface.
 17. Thedevice of claim 16, wherein the input surface is positioned at a firstangle to provide total internal reflection in the light guide; and, theoutput surface is positioned at a second angle to project the businessinformation model out of the light guide.
 18. The device of claim 11,wherein the building information model view is dynamic.
 19. The deviceof claim 11, further comprising: a set of sensors operatively connectedto the headset; and, wherein the computer is further programmed to:record position data from the set of sensors; and, calculate a positionof the headset from the position data.
 20. The device of claim 19,wherein the set of sensors include: a gyroscope; an accelerometer; and,a compass.
 21. A system for projecting a business information model at aconstruction site comprising: a set of registration markers positionedat the construction site; and, a user device comprising: a set ofheadset computation modules; a set of display units operativelyconnected to the set of headset computation modules; a set ofregistration cameras operatively connected to the set of headsetcomputation modules and directed towards the set of registrationmarkers; a computer connected to the set of headset computation modulesand programmed to carry out the steps of: receiving the businessinformation model; receiving a position image of at least oneregistration marker of the set of registration markers from the set ofregistration cameras; determining a position and an orientation of theuser device based on the position image; rendering the businessinformation model, based on the position and orientation, as a renderedbusiness information model; and, displaying the rendered businessinformation model as a stereoscopic image.
 22. The system of claim 21,wherein each registration marker of the set of registration markersfurther comprises: a unique position code; and, wherein the computer isfurther programmed to: associate the unique position code with a uniqueposition of each registration marker of the set of registration markers.23. The system of claim 21, further comprising: a movement sensoroperatively connected to at least one headset computation module of theset of headset computation modules; and, wherein the computer is furtherprogrammed to: receive headset movement data from the movement sensor;and, determine the position and the orientation of the user device fromthe headset movement data.
 24. The system of claim 23, wherein thecomputer is further programmed to: dynamically calculate a transitionposition of the user device from the headset movement data when theposition image is unavailable.
 25. The system of claim 21, wherein thesystem further comprises: a remote sensor, a network operativelyconnected to the computer, and, wherein the computer is furtherprogrammed to carry out the steps of: capturing a virtual image of avirtual object and an actual image of a physical object; and, sendingthe captured image and the actual image to the network.
 26. The systemof claim 21, wherein the computer is further programmed to carry out thesteps of: capturing a first image of the rendered business informationmodel; capturing a second image of a physical object; and, superimposingthe first image and the second image.
 27. In a system comprising acomputer, a headset connected to the computer, a display unit connectedto the headset and a set of registration cameras connected to theheadset, a method comprising the steps of: receiving a businessinformation model segment; receiving a registration image of aregistration marker; determining a position of the headset based on theregistration image; determining an orientation of the headset; renderingthe business information model segment based on the position and theorientation as a rendered business information model segment; and,displaying the rendered business information model segment on thedisplay unit.
 28. The method of claim 27, wherein the step ofdetermining a position further comprises the steps of: locating a set ofedges in the registration image; deskewing the registration image usingthe set of edges to determine a set of position angles to generate adeskewed image; receiving a set of dimensions; determining a distancefrom the set of dimensions and the deskewed image; and, determining theposition from the set of position angles and the distance.
 29. Themethod of claim 28, wherein the display unit further comprises atemporal camera, and wherein the step of determining an orientationfurther comprises: retrieving a set of movement data from the temporalcamera; and, determining a set of rotational movements from the set ofmovement data.
 30. The method of claim 28, further comprising the stepsof: reading a code from the deskewed image; locating a marker positionof the registration marker; associating the marker position with thecode; and, storing the marker position and the code.
 31. The method ofclaim 27, wherein the step of rendering further comprises the steps of:rotating the business information model segment based on the positionand the orientation; determining a clipped business information modelsegment from the position and the business information model segment;and, rendering the clipped business information model segment as astereoscopic image.
 32. The method of claim 28, wherein the step ofdeskewing further comprises the steps of: determining a set of referencelines for the set of edges: calculating a pair angle between each pairof the set of reference angles; calculating a skew angle for each pairof angles; and, rotating the registration image by the skew angle. 33.The method of claim 27, further comprising the steps of: retrieving aset of data; receiving a selection of a subset of data from the set ofdata; receiving a position and a size for the subset of data; and,displaying the subset of data at the position and the size.